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Abstract 

We derive ignorance based prior distribution to quantify incom- 
plete information and show its use to estimate the optimal work char- 
acteristics of a heat engine. 

Subjective probability or Bayesian inference methods seek to quantify un- 
certainty due to incomplete prior knowledge about the system [H [2]. The 
incomplete information is quantified as a prior probability distribution, or 
simply known as a prior and interpreted in the sense of degree of belief 
about the likely values of the uncertain parameter. The choice of an appro- 
priate prior has been a crucial issue in the Bayesian epistemology, which has 
hampered its development and general acceptance for a long time. To outline 
the framework, consider a system which depends on two parameters Ti and 
T2, where each parameter may lie within a specified range, [T_, T+j. Further, 
we are told that the values of Ti and T2 are constrained by a known relation, 
Ti = F{T2), so that given a value for one parameter, it implies a certain 
value of the other. Assume now that we have incomplete information about 
the system, which refers to an ignorance about the exact values of the above 
parameters. In this paper, we present evidence that inference based on sub- 
jective ignorance, has a close relation with optimal characteristics of certain 
thermodynamic systems. The present approach was recently proposed and 
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applied ^ to quantify similar lack of information in models of heat engines 
in |5] , where the optimal expected behavior of the engine was observed at cer- 
tain well-known efficiencies, such as Curzon-Ahlborn efficiency, 1 — a/1 — rjc, 
where rjc is the Carnot efficiency. 

The essence of our approach is to assign prior probabilities for the likely 
values of Ti or T2 . The assignment is guided by the available prior information 
about the problem, such as the similar nature of these variables, and the fact 
that the problem is symmetric with respect to Ti and T2. Thus for a certain 
pair of values, related by Ti = F{T2), one may only assign equal probabilities 
for these values, in the range [Ti,Ti + dTi] and [T2,T2 + dT2], respectively. 
This principle implies the following: 

P(Ti)rfTi = P{T2)dT2. (1) 

Note that we have chosen the same distribution function P for both Ti and 
T2. The task then is to solve for the function P, and find the estimate for 
T2, defined as T2 = J T2P{T2)dT2, the average value over the prior. The 
corresponding estimate for Ti is given by Ti = F{T2)- Any other quantity 
pertaining to this system which is a function of Ti and T2, may be estimated 
based on these values. 

It is easy to visualise a physical analog of the above scenario. Consider 
a pair of thermodynamic systems, identical in all aspects, except that their 
initial temperatures are T+ and T_, respectively. Assume that T+ > T_. 
Let the fundamental thermodynamic relation of each system is given by S oc 
U'^'^, where the constant of proportionality may depend on some universal 
constants and/or volume, particle number of the system. Using dS/dU = 
1/T, we get: U oc T^/i^-^-^). Alternately, we can write S oc T'^i/(i-'^i). 
We restrict to the case < Ui < 1, which implies systems with a positive 
heat capacity. Some well-known physical examples in this framework are the 
ideal Fermi gas (wi = 1/2), the degenerate Bose gas (wi = 3/5) and the 
black body radiation (cui = 3/4). Classical ideal gas can also be treated as 
the limit, Wi — )■ 0. 

Now assume that after some mutual interaction, the temperatures of the 
two systems become Ti and T2 and the relation between them is specified as 
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follows: 

Ti = + T_'^ - - , (2) 

where uj = wi/(l — ui). Physically, this dependence is obtained if we regard 
the interaction as a reversible process, preserving the thermodynamic entropy 
of the composite system [6]. This implies AS = ASi + AS2 = 0, where 
AS = S'fin — 5'ini. Moreover, one can extract work (W) in this process, 
which is equal to the decrease in internal energy (U) of the total system, 
W = —AU, where AU = f/fin — f/ini. The expression for work (upto a 
constant of proportionality) is: 

W={T+^ +T_^)-{Ti^ +T2^). (3) 

Substituting the value of Ti from Eq. ([2]) into Eq. , we may regard W as 
a function of T2 only: 

W = T+T^ + - (T+'^ + T_'^ - Ts'^)^ - T2^. (4) 

One may continue to extract more work till the two systems achieve a com- 
mon temperature T^. We call this the optimal work extractable from the 
initial set up, where the final temperature of the systems are given by: 

T..[I^I^f. (5) 

Now let us regard the incomplete information in the present context, to arise 
from a lack of knowledge about the intermediate temperatures, Ti and T2. 
Specifying the physical process fixes only the functional relation between 
them, Ti = F{T2). As discussed in the Introduction, we invoke the device 
of two players A and B, who assign probabilities for Ti and T2 respectively, 
according to their degree of belief. Then implementing the criterion of Eq. 
([1]), we obtain the following normalised prior: 

rp UJ-1 

P(K, = J^^y (6) 

where 6 = T_/T^. We have chosen to do the analysis by using T2 as the vari- 
able. The symmetry between Ti and T2, in the work and entropy expressions, 
indicates that equivalently we can also use the variable Ti. 
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The expected value of T2 is: 



T2 = / T2P{T2)dT2. 



(7) 



In the following, we choose = 1, for simplicity. After solving the above 
integral, we obtain 



T2 = wi- 



The expected value of work can be found by substituting T2 in place of T2 
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Here subscript p refers to the power-law prior. The input heat {Q) is given 
by the difference of the initial and the final energies of the initially hotter 
system. We can estimate the value of this quantity similarly as above. The 
result is 
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Finally, the efficiency is estimated by 77^ = Wpj Qp, and is given by: 
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Now how does these estimated quantities compare with those arrived from 
other priors? Or more significantly, how do the estimates compare with some 
intrinsic features of the system, such as optimal work extracted? 

For this purpose, we note the corresponding expressions for work and 
efficiency, when a uniform prior is used. This prior might appear as a natural 
choice in case the only information about the uncertain parameter is its range, 
[T_,T+]. For T+ = 1, the uniform prior is given as 

dT2 



PiT2)dT, 
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So the expected values of different quantities are as follows: 

^ i + e 



(13) 



TF.^i- i + r- V^^^-m^"^ (14) 
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(¥) 



^« = 1 + — : ' / 1 • (15) 

Here subscript m refers to the uniform prior. 

For optimal work, the final temperatures of the two systems are equal. 
Substituting Ti = T2 = in Eq. ([3]): 



Wo = i + - 2 1 I . (16) 



The efficiency at optimal work, is given by: 

Fig. 1 shows the main result of the paper in the form of plots comparing 
Wp, Wu and Wo for systems with different values of Ui. We note in the 
near-equilibrium regime, there is a close proximity between the estimated 
work (calculated with either prior, uniform or power-law) and the optimal 
work. In fact, expanding Wp, Wu and Wo about 6' = 1 up to third order, we 
obtain, in each case 

^--(l-ci) 4 +(l-c.O^ 8 +^[1-^] • (18) 

There is a remarkable agreement, upto third order, between the estimated 
and the optimal work. The estimate appears to be insensitive to the choice 
of the prior, in this regime. However, far from equilibrium, we see in general, 
deviations between the behavior predicted by different priors. Particularly, 
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Figure 1: Work as a function of 6*; (a) Ideal classical gas {ui — )■ 0), (b) Ideal 
Fermi gas (wi = 1/2), (c) Degenerate Bose Gas {ui = 3/5), (d) Black Body 
radiation {ui = 3/4). The dashed curve is for Wo, thick curve is for Wp, and 
thin curve is for Wu- 



in the limit 6' — )■ 0, 

Wp = i-c^r^^ -{i-ur^)^, (19) 




= i-y . (21) 

In general, we observe that the results from the power-law prior are very close 
to the optimal behavior. It is remarkable that an average over the ignorance 
probabilities can yield good estimates of the optimal characteristics of the 
engine. 

We also compare the estimates for efficiency, with the efficiency at optimal 
work. Expanding r/p, rj^ and rjo about 6' = 1 up to 2nd order. 



6 



(a) 



(b) 




9 e 



(c) (d) 

Figure 2: Efficiency as a function of 9\ (a) Ideal classical gas, (b) Ideal Fermi 
gas, (c) Degenerate Bose gas, (d) Black Body radiation. Dashed curve is for 
rjoi thick curve is for fjp and the thin curve is for r/„. 

2 + (l-a;i)24+^^^J 
2 + (l-cui) 8 ^ ^^^^ 

It is also observed that for ui = 1/2 (ideal Fermi gas), we have an exact 
equality of both the work and the efficiency estimates with the optimal char- 
acteristics (see Fig. lb, Fig2b). Actually, the power-law prior becomes the 
uniform prior for this case. The efficiency at optimal work in this case gets 
simplified to rjp = rj^ = rjo = ^rjc/ (4 — rjc), where rjc = {I — 0) . Interestingly, 
this expression also arises within the framework of stochastic thermodynam- 
ics applied to a model of brownian heat engine [7] . 

In the above comparison, we have seen that power-law prior with a specific 
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Figure 3: Variance of T2 as function of 9. (a) Classical ideal gas (b) Fermi 
ideal gas (c) Degenerate Bose gas, (d) Black body radiation. Dashed curve 
is for uniform prior, while the solid curve is for power law prior. 



exponent, yields a better estimate for optimal work extraction, as compared 
to the uniform prior. A measure for the reliability of the estimates may be 

the variance of the estimated parameter T2, which is evaluated as: 

2 

(25) 
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and using the uniform prior, we have 

Vu 



1 - 01—1 



'1 



12 



(26) 



Fig. 3 shows the comparison of the variance for both the priors, for dif- 
ferent systems. In general, the variance of T2 is less for power-law prior 
than for uniform prior, reflecting the higher reliability of the power-law prior 
estimates. 

Concluding, we find evidence suggesting the relevance of ignorance based 
priors to infer the optimal characteristics of a heat engine with two finite 
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reservoirs. The final state in case of optimal work extraction is tlie equi- 
librium state (minimum total energy) when temperatures of both reservoirs 
become equal. The ignorance based approach yields good estimates of the 
final state, from a consideration of the intermediate nonequilibrium states. 
For small temperature differences, the results are not sensitive to the prior 
and a uniform prior is equally good to estimate the optimal behavior. Far 
away from equilibrium, the results are sensitive to the choice of a prior. So 
we have presented arguments for the choice of the prior. The characteristics 
of the engine are estimated by averaging with the prior over all the values 
of its range. The present approach might indicate a subtle relation between 
the equilibrium and nonequilibrium states. Can there be a possible relation 
with the recent fluctuation theorems, where the information on equilibrium 
free energies is obtained by averaging over nonequilibrium paths [H [9]? 
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